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This paper presents a research method deriv-ed from 
the functional analysis of behavior currently common among operant 
behavior therapists. Naturalistic observation, the method used, 
encompasses behavioral-level description of events, systematic 
observation and recording by means of codes, assessment of 
inter-judge reliability, as well as targeting both verbal and 
nonverbal behaviors. This method is applied to therapist behavior in 
group psychotherapy as a first step in its verification and 
application to more complex interactions. The results of this 
investigation support the idea that many therapist behaviors can be 
readily classified by use of naturalistic observation procedures. 
These procedures, specifically designed for gathering data with a 
minimum of interference yet without sacrificing either precision or 
reliability, retain the spontaneity which systematic laboratory 
efforts have often lost. References are included. (Author/SES) 
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CATION POSITION OR POLICY 



This papc>r y.rcre;ilT a research me-thod deriveu . 
from tho r'ur.ctioral Jinalysis of behavior cur-- 
rerrtly cc. . y.i Dn^c operbrc behavior therapists;. 
This rr:Ox):co is applied xo -therapist behavior in 
group pcvchoxr.erapy as a ilrst step in its 
verific?ticr. and application to more coiiiplex 
intceracticns. 



Naturalistic observation procedures have proved 
applicable to a nunibcr of clinical prcbleriS (Barton, et» 
aiffiy/O; Craig & Holl?ind, iyyOj O'Leary et«al#, i969i 
V/ahler, 19^9) • These technicues» elaborated by Bijou and 
his associates (1969)1 are a conceptual extension of the 
functional analys'j of behavior and single-rjubject design 
to free-field settin.(;s* Naturalistic observation as an 
analytic method encoripasses behavioral-lovel description 
of events, systematic observation and recording by means 
of codes, asfressnent of inter- judge reliability, as well 
as targeting both verbal and nonverbal behaviors « 

Logically it would seem that this niethod could be 
eraxAoyed beyond developing pror^rams for children who are 



This paper is part of a thesis submitted to the Graduate 
Division of the University of Hav/aii in partial fulfillment 
of the recuirc-r;ent3: :or the de-^ree of :.a.vtGr of Arts in 
Psychology. Recuer/c:, for reprints should be sent to Leslie 
B. v;sissV rjopartoer.t of Psychology, University of Hawaii, 
Honolulu, i.'av.aii 96o22. 



disruptive in class (Kubany, et. al., 1971)* It is ideally 
suited, for instance, to analysir-g a complex social situ* 
ation v/ith consistent, repeating elensnts, and also for 
exardning the action patterns of these elements; that is, 
hov; often and under v/hat social circumstances people 
^'^^Z^C>^ in a behavior • 

Group psychot.'iarapy is one complex social situation 
v;hich invites investigation e Several issues present them* 
se].ves: Can naturalistic observation procedures be 
effectively applied in a study of groups, and to which 
aspects? I.'ore specifically, can therapeutic maneuvers 
be broken dov/n into observable units'" Can a therapist 
label his cv/n behavicraX units and can he expect ethers 
to grasp his- concepts? 

Phase I: Sampling the Therapist's Behavior 

A clinical psychologist v/ith six years of experience 
volunteered to serve as a model of therapist behavior 
during group therapy* Plis conceptual and methodological 
orientations may be described as Gestalt-Kumanistic 
(Pagen & Shepherd, 1970; Perls, 1969; Schut2,1967)« 
The "model therapist" conducted tv/o different therapy 
groups • Menibers of both groups v/ere carefully screened* 
They all reported difficulties in interpersonal relations 
and complained largely of anxiety, depression, and/or 



lonlinoss. Videotape recordings of the clinician's behavior 
during each group provided a permentnt record. 

The firsx group v.as conducted in the mental health 
clinic of a local hc£=-pital. This group consisted of seven 
'.vomen and three men. plus the nodel therapist and his 
co-therapic.,t. Groi^p r.ossions lasted fror. two to six hours 
xvith v/eekly r^ioetings over a four month period. This group 
v;as routinely observed through a one-way mirror by trainees. 
Tho recording equipraent was stationed with tnem in the same 
room. Portions of the fourth, fifth, sevente.enth, and 
eighteenth r.estings v/ere taped yielding four hours of film. 

The second group, a marathon, lasted forty-eight 
hours . Eight •.vomen and five nien participated. The video- 
tape equipment ^vas set up in a large doorway and a micro- 
phone was placed on a wall where it went unnoticed. 
Three hours of film v/ere Kade. 

In both groups the camera crew was instructed to 
focus on the therapist, including only enough patient 
activity to provide a context for his actions. 

Pjiase lit Dcvelog nLont of the Behavior CodP 

V/hen the films were completed, the model therapist 
viewed thorn with the investigator and commented on his 
actions. In addition to describing himself th^ model 
therapist provided specific labels for what he saw. 



coBuaonly adding the defining features. For example, he 
looked at his nonverbal behavior, a particular posture, 
and called it his "detatched, attentive posture? inter- 
mediate level involvement." v.'hen he heard hin:self say on 
the tape, "If you trust your organism, you'll do what 
you -want," he labelled this a "didactic intervention- 
teaching my theory." V/hen it was not clear how the model 
therapist organized his observations, he was asked to be 
more specific. Every atte:n?t was made to avoid telling 
him how he appeared. The object of this inquiry was to 
elicit the model therapist's o\m organization of his 
behavior, prompting only a concrete descriptive level 

follOV/in.T an ethnOSr;i«^»^+T ■f'i !a-n-r,>-.r;n<^V. f'.tJr>^<^r^ c. r-nlT^ 

1970). 

The result of this discussion was a list of some 
discrete therapist behaviors. These were spontaneously 
placed on two dimensions by the model therapist — 
involvomont and verbal intervention. Examples of each 
category were chosen from the videotapes and the defini- 
tions were organized into a manual, or code bool?i for 
easy reference. 



Phase Il lt The Code Bnnk 

The cods reflected the two dimensions of therapist beha- 
vior. Involvement was defined posturallyj that is, the 



model therapist believed his posture reflected the in- 
tensity of his interaction v/ith the patient • Five dis- 
tinct body positions were identified. 

In the verbal intervention dii^.ension the therapist 
talks to the patient. Seventeen different verbal inter- 
ventions v/ere labelled by the clinician} eight v/ere selec- 
ted for investigation. The criterion for inclusion in 
the code book v/as at least five occurrences during the 
seven hours of taped behavior. Nine verbal categories 
did not occur often enough to permit inclusion. 

One nonverbal behavior, monitoring, v;as included 
as an alternative to the verbal intervention. 

P hase IV; Inter-Observer Reliability 

Examples of each behavior category were selected from 
the filmed material and edited into a forty-minute 
videotape. The tape was in two parts. The first section 
consisted of those items contained in the code book and 
served as illustrations. This training section v/as 
followed by forty-three test items randomly arranged which 
the judges were to observe and rate using the therapist 
behavior code. 

To determine if the model therapist •s categories were 
communicable, five judges and the model therapist were 
asked to categorize the videotaped samples of therapist 
behavior. These observers ranged v/idely in theoretical 
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orientation adn clinical experience. Among them were 
three Ph-D psycholo£;ists, two graduate students, and an 
undersracuate. Clinical practice ranged from eight years 
to none at all» Four of these observers had used 
similar coding procedures in other contexts. Two of the 
judr^es, including the model therapist were unfamiliar 
with this technique. 

The training section of the tape was shov/n first. 
Discussion of the categories and the examples clarified 
questions about both the definitions and the rating 
procedure. For each subsequent test itcia raters then 
recorded which of the eight verbal interventions occurred 
and which of the five postures the therapist assumed. 

Results 

The model therapist's observations were considered 
the criterion. Item agreement was calculated between 
the Tiiodel therapist's judgment of each item and those of 
each other observer. The reliability coeffecient,R , was 
deterirdned by dividing the number of agreements by number 
of agreements plus disagreements (after Bijou, et.al., 
1969). R was obtained for each pair of raters for each 
dimension of therapist behavior. That is, inter- judge 
agreement about verbal intervention was calculated 
separately from intei>judge agreement about posture. 



Reliability coeffecicnts were then determined with the 
two dimensions combined into a unit. Both judgments — 
type of verbal intervention and posture — had to match 
for the ratings to be considers - in agreement. 

The mean inter-- judge agreement for type of verbal 
^intervention was 85,6>1, for posture, 90. 6^,t., and for the 
whole behavioral unit, 79 tO/.. 

Discur^ sion 

Does the model therapist behave systematically 
enough in a group situation that his actions can be 
categorized? Can he identify his ovm behaviors and 
communicate hi.s labels to others? Can a descriptive 
method identify behavioral variables in such a complex 
interaction situation as group therapy?- 

The results of this investigation support the idea 
that many therapist behaviors can be readily classified. 
The two interacting dimensions of behavior in this 
study produced a possible forty-five distinct units of 
behavior which v/ere discriminated with a mean reliability 
of 79 •0,1; for five naive observers. 

The communication value of the model therapist's 
labels is reflected in the reliability coeffecient of each 
category. V/ith only two exceptions, agreement among the 
observers ranged between 75>1 and 100;^ with a mean of 
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89 • 5^;^* This suggests that this model therapist can 
comraunicate accurately about his ovm clinical behavior.' 
Since the defining features for each category were pro- 
vided by the clinician v/ith minimal prompting by the 
investii:aocri these labels reflect largely his own ideas* 
In short I an idiosyncratic behayior rating scale v/as 
developed for the nodel therapists 

The larger issue, hov/over, is the applicability of 
this naturalistic approach to more complex clinical 
investigations • It v;as not intended in this stuciy to 
detail the whole clinical repertoire of the model thera- 
pist* The behaviors selecteu depenaeri partly on their 
frequency and partly on how easy they were to identify^ 
The fourteen high-frequency behaviors were sufficient to 
demonstrate the reliability of the methodt 

Before research into the complex interactions in group 
therapy can proceed along these lines it is necessary to 
validate the application of the method to patient behavior. 
A preliminary investigation has produced encouraging 
results (Duhig, 1970} V/eiss, 1970) • For one dimension 
of patient verbal behavior, congruent expression of feelings, 
inter-rater reliability of 97;5 was achieved. This indi- 
cates that aspects of patient behavior in groups may be 
amenable to naturalistic investigation. 

The naturalistic observation procedure has several 
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aclvantases and potential applications. First, it can 
produce idiosyncratic behavior rating scales in contrast 
to the standardized ones widely used tc rate both patients 
and therapists. Such scales cr.n be orfianij'.ed to reflect 
either the special constructs cf the target therapist or 
those of the experinoiiter , as desired. 

Secondly, a descr'iptive behavioral code could pro- 
vide infors.ation about generalization and persistence 
of treatment effect.-j. For instance, changes in patient 
behavior repertoires could be narked in the group as 
well as concurrently outside the group and after the 
crroii-n tei'Minates. 

Thirdly, coding has potential as a training device. 
The enphasis upon defining and recording behavioral 
variables focuses attention on observable intei-personal 
events. Observation is an important clinical shill and it 
improves with practice. Training in observation can 
saisitizG clinicians to their ovm behavior %s well as the 
patients' thus increasing their self-awareness. 

Fourthly, videotape sair.pling of therapist behavior 
might becone a useful adjunct to clinical training. It is 
well established tliat symbolic modelling is an effective 
v/ay to produce new patterns of behavior (Bandura, 1969) » 
but in addition to passive observatinnal learning, trainees 
could be actively coding, thus focusing their attention 
O on sT)ecific, subtle cues emitted by both patient and 
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clinician. This r.i£ht speed both the learning of a 
distinct repertoire of clinical tGchniquos by modelling 
and accelerate the acquisition of observation skills. 

. The interactions of psychotherapy are natural 
events althou-h they are often studied by exporinentax 
procedures, v/hile systematic laboratory efforts may 
give us a good deal of information about relevant varia- 
bles, it is often at the expense of the spontaneous 
process. Naturalistic observation procedures are specifi- 
cally designed for gathering data v/ith a minimum of 
interference and thus seem an ideia tool for "free-field" 
studies of the therapeutic process without sacrificing 
ui oiiyr iJVtiOXaloii or reliability. 
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